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This  work  is  funded  by  the  Air  Force  Office  of  Scientific  Research 
and  the  Air  Force  Research  Laboratory 


To  further  understand  the  achievability  of  CRBs 
by  MFBD  algorithms  (PCID  is  being  used  for  these 
resuits) 

—  At  what  SNRs  do  CRBs  start  becoming 
unachievable? 

—  In  which  domain  is  the  achievability  of  the 
CRBs’  best  analyzed? 

—  How  do  the  PCID  sample  variances  degrade  as 
the  SNRs  get  worse? 

*  is  this  a  function  of  how  the  SNRs  are 
lowered  (i.e.,  more  Poisson  noise,  more  read 
noise,  poorer  atmosphere,  etc.) 

—  Etc. 


We  conducted  this  research  to  better  understand  how  Cramer-Rao  lower  bounds  can  be 
used  to  understand  the  performance  of  multi-frame  blind  deconvolution  algorithms  such 
as  PCID.  It  was  clear  from  previous  results  that  we  generated  that  the  image-domain 
sample  variances  from  PCID  deviated  from  the  CRBs  significantly  more  than  was 
expected  given  the  signal-to-noise  ratios  of  the  data.  It  was  our  suspicion  that  the 
Fourier  domain  was  a  better  place  to  carry  out  this  investigation.  It  will  be  shown  that 
this  is  true. 


Imaging  Model 

•  Raw  measurements  {in,(x)},  m=1,...,M,  are  modeled  as 

im(x)  =  h„(x)*o(x)+n„(x) 

where  o(x)  is  the  true  object,  h,^(x)  is  the  point  spread 
function  (PSF)  blurring  the  measured  data,  and  nn^(x) 
is  zero-mean  noise  for  the  m'^  image 

—  nn,(x)  models  both  read  noise  and  Poisson  noise 

—  h^{x)  is  invertible"  derived  from  atmospheric  PSPs 


This  is  the  standard  simple  linear  imaging  model.  The  only  difference  that  we  impose 
that  the  PSFs  must  be  invertible.  This  is  necessary  to  be  able  to  calculate  the  CRBs. 
Although  this  means  that  we  didn’t  use  realistic  PSFs.  we  believe  that  the  conclusions 
we  draw  will  be  extensible  to  realistic  PSFs. 


This  is  a  flowcliart  olTho  I’CID  algorithm  showing  the  cost  function,  the  equations 
describing  the  measurements,  and  a  sample  reconstruction.  This  chart  was  taken  from  a 
previously-cleared  briefing  (Case  Number  RD08-021 1 ) 


What  Are  Cramer-Rao  Lower 
Bounds? 


*  Given  a  parameter,  a  measurement  that  contains 
information  about  that  parameter,  and  a  probability 
density  function  that  describes  the  randomness  in  the 
measurement,  CRBs  can  be  calculated  which  are 
lower  bounds  to  the  variance  of  any  estimate  of  that 
parameter  given  the  measurement 

*  We  will  calculate  CRBs  for  estimates  of  an  object’s 
pixel  intensity  values  and  estimates  of  an  object’s 
Fourier  energy  spectrum  values 

*  We  calculate  the  Fisher  information  matrix  for  the 
image-domain  CRBs  and  use  it  for  both  image-domain 
and  Fourier  domain  CRB  calculations 


Standard  textbook  description  of  Cramer-Rao  lower  bounds. 


Our  Previous  PCID/CRB  Results 


Non-blind  results 


Scenario 

PCID/CRB  Ratios 

Mean 

Minimum 

Maximum 

Non-blind  and  unbiased  estimation 

0.9904 

0.9402 

1.0326 

Non-blind  and  Tikhonov-regularued 
estimation 

1.0235 

0.9627 

1.0768 

Blind  results 


Noise  Values 

PCID/CRB  Ratios 

OCNR 

TWo-cIrc 

Single-pixel  read  noise  variance  ^  o.l 

1.013 

1.024 

Single-pixel  read  noise  variance  =1.0 

1.205 

1.172 

Single-pixel  read  noise  variance  =  2.0 

1.321 

1.306 

Photon  noise  tor  10’  photons 

1.014 

0.994 

Photon  noise  tor  10’  photons 

1.173 

1.181 

C.  L.  Matson,  et  al.'Fast  and  optimal  multi-frame  blind  deconvolution  algorittim  for  high- 
resolution  ground-based  imaging  of  space  objects,*  Appfmd  Optics  48.  A75-A92  (2009) 


In  our  previous  work,  we  carried  out  an  extensive  number  of  comparisons  between 
PCID  sample  variances  and  the  associated  CRBs  for  non-blind  deconvolution.  As  can 
be  seen  in  the  top  table,  there  is  close  agreement  between  tlie  two. 


For  blind  results,  the  story  is  quite  different.  We  were  only  able  to  get  five  comparisons 
between  PCID  and  CRBs  in  time  for  the  paper.  We  can  see  that,  as  the  SNRs  of  the  data 
decrease,  the  match  gets  worse.  But  the  match  seems  to  be  much  worse  that  would  be 
expected  from  the  absolute  values  of  the  data  SNRs.  The  purpose  of  this  presentation  is 
to  explore  this  issue  further. 


Tables  from  previously-cleared  paper  Case  Number  RD08-02 1 1 . 


Tliis  figure  is  from  the  referenced  paper.  The  important  thing  to  observe  in  this  figure  is 
that  the  MLE  MSEs  match  the  CRBs  very  well  for  SNRs  >  3.5  or  so,  and  then  become 
much  larger  than  the  CRBs.  As  will  be  shown,  we  can’t  get  this  kind  of  curve  using 
image-domain  CRBs,  but  we  can  in  the  Fourier  domain. 


w 


CRB  &  PCID  Calculation 
Parameters 


Atmospheric  PSFs,  DItq  =  8,  made  invertible,  two  versions 
Read  &  Poisson  noises 
Support  constrained  restorations 

—  PSF  supports:  circles  -  truth,  4x  the  area  of  truth 

—  Object  supports:  true  and  (smaiiest)  circuiar 
No  positivity  constraints  or  reguiarization  used 


ocnr 


#• 

psf1 

psf2 

These  are  the  parameters  for  the  CRB  and  PCID  calculations.  The  two  PSFs  used  for 
the  results  were  generated  from  simulated  D/ro  =  8  data,  but  then  clipped  by  circular 
supports.  The  radius  of  PSF2’s  clipping  is  twice  as  large  as  PSFl 's  clipping,  so  PSF2 
has  four  times  the  area  of  PSF  1 . 


t  J  Why  Regularization  And  Positivity 
T**  Were  Not  Included 


*  Regularization  and  positivity  produce  biased 
reconstructions 

—  Thus  unbiased  CRB  values  are  not  applicable 

*  One  can  incorporate  biases  into  the  CRB  calculations 

—  But  one  must  be  able  to  analytically  calculate  the 
bias  gradient  matrix 

—  Impossible  for  positivity 

—  I  believe  that  it  is  impossible  for  blind 
deconvolution 

•  It  is  possible  for  single-frame  non-blind 
deconvolution,  though 


In  essence,  I  don’t  know  how  to  calculate  CRBs  for  positivity-constrained  or  regularized 
MFBD.  I’m  not  sure  that  there  is  a  way  to  do  so.  But  since  I  don’t  know  how,  I  don’t 
include  them  in  the  results. 


Baseline  Case:  Image  Domain  Results 

#  photons  =  10^;  read  var  =  100;  true  object  supp;  true  PSF  supp;  PSF1 


Sample  image 
reconstruction 


CRB-based 
SNRs  per  pixel 


Normalized  PCID  variances 
versus  SNRs 


Bias''2A/ar  =  0.026 


This  is  the  baseline  case  against  which  all  other  results  are  compared.  The  CRBs  and 
PCID  sample  variances  describe  how  accurately  PCID  was  able  to  reconstruct  the  true 
object  intensity  values  per  pixel.  The  parameter  values  used  for  the  baseline  case  are 
shown  above,  and  result  in  nice-looking  reconstructions  (left-most  figure).  The  middle 
figure  is  the  CRB-based  image-domain  SNRs.  It  was  generated  by  dividing  the  true 
object  by  the  square  root  of  the  image-domain  CRBs.  The  right-most  figure  is  a 
scatterplot.  Each  point  corresponds  to  a  pixel  location  in  the  image  domain,  and  each 
point  is  the  value  of  the  ratio  of  the  PCID  sample  variance  at  that  pixel  location  to  the 
CRB  at  that  pixel  location.  This  figure  corresponds  to  the  figure  on  slide  8,  where  in 
both  figures  the  horizontal  axis  is  SNR  on  a  log  scale.  The  vertical  axis  in  the  figure  on 
slide  8  is  mean  square  error.  The  vertical  axis  in  this  figure  is  nonnalized  variance. 
Because  we  are  seeking  unbiased  estimates,  nonnalized  variance  is  equal  to  normalized 
MSE.  The  tenn  ‘normalized’  means  that  the  sample  PCID  variances  are  divided  by  the 
CRBs,  so  for  each  pixel,  the  normalized  CRBs  are  just  one.  Recall  that  we  want  to 
replicate  the  shape  of  the  CRB  curve  and  the  sample  variance  curve  in  the  figure  on  slide 
8,  where  the  CRBs  and  sample  variances  are  equal  to  each  other  for  high  SNRs,  and 
deviate  at  low  SNRs,  with  the  PCID  sample  variances  higher  than  the  CRBs.  Notice  that 
this  isn’t  the  case.  Thus,  the  image  domain  is  not  the  right  place  to  carry  out  this 
analysis. 


Recall  that  the  CRBs  being  calculated  arc  lower  bounds  to  unbiased  estimates  of  the 
image  intensity  values  per  pixel.  We  monitor  the  bias  of  the  PCID  reconstructions  to  see 
if  they  are  truly  unbiased.  On  all  the  slides,  the  image-domain  ratio  ofbias'^2  to  variance 
(the  appropriate  measure)  is  given.  Generally  speaking,  we  consider  a  PCID 
reconstruction  to  be  essentially  unbiased  if  this  ratio  is  much  less  than  0.1 . 


Baseline  Case:  Energy  Spectrum  Results 

#  photons  =  10^:  read  var  =  100;  true  object  supp;  true  PSF  supp;  PSF1 


CRB-based  SNRs  versus  Normalized  PCID  variances  Normaiized  PCID  variances 
normaiized  frequency  versus  frequency  versus  SNRs 


Tliis  is  the  baseline  case  against  which  all  other  results  are  compared,  looked  at  in  the  Fourier  domain.  To 
generate  these  results,  we  calculate  the  energy  spectrum  of  each  PCID  reconstruction  and  calculate  sample 
variances  for  the  energy  spectrum  estimate.  It  is  important  to  realize  that  we  don’t  estimate  the  energy 
spectrum  directly  from  the  data,  as  is  the  case  for  speckle  imaging.  We  calculate  the  PCID  reconstructions 
directly,  and  then  transform  to  the  energy  spectrum  domain. 


Similarly,  we  calculate  the  Fisher  infonnation  matri.x  (FIM)  corresponding  to  estimating  the  object  in  the 
image  domain,  which  is  the  same  FIM  used  for  the  image-domain  CRB  calculations,  invert  it,  and  then  pre- 
and  post-multiply  it  by  the  appropriate  matrices  which  generate  the  energy  spectrum  CRBs  from  the  image- 
domain  FIM.  Tlic  image-domain  CRBS  are  the  diagonal  elements  of  the  inverse  FIM  matri.x.  Tlic  energy 
spectrum  CRBs  are  the  diagonal  elements  of  the  inverse  FIM  after  pre-  and  post-multiplying  the  inverse 
FIM  by  the  appropriate  matrices. 


The  plot  on  the  left  arc  the  energy  spectrum  SNRs  as  a  function  of  nonnalized  spatial  frequency  magnitude. 
Each  point  on  the  plot  is  the  average  of  all  the  SNR  values  for  a  given  spatial  frequency  magnitude.  It  can 
be  seen  that  the  SNRs  stay  above  one  almost  everywhere,  on  average,  for  a  given  spatial  frequency 
magnitude;  however,  there  is  a  significant  amount  of  lluctuation  in  the  SNR  values  that  make  up  the  average 
SNR  at  each  spatial  frequency  magnitude.  The  figure  in  the  middle  is  the  2-D  PCID  energy  spectrum 
sample  variance  map  divided  by  the  CRB  energy  spectrum  map.  To  more  easily  see  the  ratio  values  that  are 
on  the  order  of  one,  the  gray  scales  in  the  figure  (and  all  the  corresponding  figures  in  the  following  slides) 
range  between  0  and  4.  Notice  that  the  ratios  are  near  one  in  an  approximately  circular  region  centered  on 
zero  spatial  frequency.  From  the  plot  in  the  left-most  figure,  it  can  be  seen  that  this  is  the  region  where  the 
SNRs  are  the  highest.  At  the  highest-spatial  frequencies,  the  ratios  start  increasing  well  beyond  one,  which 
is  where  the  SNRs  arc  the  lowest. 


As  on  the  previous  slide,  the  ratio  of  the  PCID  energy  spectrum  sample  variances  to  the  energy  spectrum 
CRBs  for  each  spatial  frequency  are  plotted  in  the  right-most  figure,  where  the  horizontal  axis  is  SNR  on  a 
log  scale,  and  the  vertical  axis  is  nonnalized  PCID  sample  variance  on  a  log  scale.  Notice  that  this  figure 
shows  the  shape  we  were  hoping  for;  that  is,  the  PCID, 'CRB  ratios  are  close  to  one  for  high  SNRs,  and 
become  large  for  small  SNRs.  The  transition  between  the  two  regions  occurs  around  an  SNR  of  1  to  2. 

We  repeat  the  image-domain  bias^2/var  ratio  on  this  screen  to  keep  it  in  view.  We  don’t  calculate  the 
bias^2/varof  the  energy  spectrum  estimates,  because  it  is  known  that  energy  spectrum  estimates  are 
inherently  biased  due  to  measurement  noise  that  is  zero  mean.  When  this  bias  is  known,  it  can  be  subtracted 
out  prior  to  e.stimating  the  energy  spectrum.  For  speckle  imaging,  this  bias  is  known  exactly.  For  blind 
deconvolution,  it  isn’t,  so  we  can’t  subtract  it  out.  Tlie  variances  remain  the  same,  unaffected  by  the  biases, 
so  that  isn’t  an  issue. 


w  Case  1:  Image  Domain  Results 

#  photons  =  10';  read  var  =  100;  true  object  supp;  true  PSF  supp;  PSF1 


Sample  image 
reconstruction 


CRB-based 
SNRs  per  pixel 


Normalized  PCID  variances 
versus  SNRs 


Bias'‘2A/ar  =  0.0025 


In  all  the  remaining  slides  prior  to  the  conclusion  slide,  the  baseline  case  results  are 
shown  on  the  bottom  half  of  the  page,  while  the  results  under  investigation  are  shown  on 
the  top  half  We  vary  the  reconstruction  parameters  one  by  one  and  see  what  their 
impact  is. 


This  slides  shows  the  image-domain  results  for  lO'^S  photons,  as  compared  to  the  10''7 
photons  in  the  baseline  case.  Notice  that  the  image  reconstruction  is  clearer,  and  the 
PCID  sample  variance/CRB  ratios  arc  much  closer  to  one.  Furthermore,  the  average 
bias''2/var  ratio  is  a  order  of  magnitude  lower  than  for  the  10^7,  as  is  expected  because 
there  is  much  less  chance  of  being  trapped  in  local  minima  in  the  PCID  cost  function 
minimization. 


Case  1:  Energy  Spectrum  Results 

#  photons  =  10';  read  var  =  100;  true  object  supp;  true  PSF  supp;  PSF1 


CRB-based  SNRs  versus  Normalized  PCID  variances  Normalized  PCID  variances 
normalized  frequency  versus  frequency  versus  SNRs 


Baseline  case 


Bias'aA/ar  =  0.026 


Here  the  energy  spectrum  results  are  shown  for  1 0''8  photons.  Notice  that  the  energy 
spectrum  PCID  sample  variance/CRB  ratios  are  much  closer  to  one.  What  is  interesting 
is  that  the  plot  of  the  ratios  as  a  function  of  SNR  is  essentially  the  same  shape  as  the 
baseline  case,  just  more  heavily  weighted  to  higher  SNRs  because  of  the  larger  number 
of  photons. 


Case  2:  Image  Domain  Results 

#  photons  =  10‘;  read  var  =  100;  true  object  supp:  true  PSF  supp;  PSF1 


Sample  Image 
reconstruction 


CRB-based 
SNRs  per  pixel 


Normalized  PCID  variances 
versus  SNRs 


Bias^2A/ar  =  0.18 


This  is  the  10''6  case.  Notice  that  the  image  reconstruction  is  much  noisier.  Notice  also 
that  the  PCID  sample  variance/CRB  ratios  are  noticeably  less  than  one.  Since  the  CRBs 
are  lower  bounds  to  the  variances  of  any  unbiased  estimates  of  the  image-domain 
intensity  values,  the  reconstructions  must  be  biased.  In  fact,  they  are  -  notice  that  the 
bias'^2/var  ratio  is  0.1 8. 


Case  2:  Energy  Spectrum  Results  .,^L| 

#  photons  »  10‘:  read  var  =  100;  true  object  supp;  true  PSF  supp;  PSF1 


CRB-based  SNRs  versus  Normalized  PCID  variances  Normalized  PCIO  variances 
normalized  frequency  versus  frequency  versus  SNRs 


Bias''2A/ar  >0.18 


Baseline  case 


These  are  the  energy  spectrum  results  for  10''6  photons.  Notice  that  the  SNRs  are 
significantly  lower  than  the  baseline  case,  and  that  there  are  a  lot  more  spatial 
frequencies  where  the  ratios  are  much  greater  than  one.  But  notice  that,  again,  the  shap 
of  the  plot  of  the  nonnalized  PCID  variances  as  a  function  of  SNR  is  virtually  identical 
to  the  corresponding  plots  for  10''7  and  I0''8  photon  levels  for  high  SNRs.  It  is  only  in 
the  low  SNR  region  that  the  plots  differ.  This  is  an  e.xciting  result,  because  it  indicates 
that  including  lowcr-SNR  data  points  in  the  estimation  process  doesn't  increase  the 
variances  of  high-SNR  locations. 


w  Case  3:  Image  Domain  Results 

#  photons  =  10^;  read  var  =  100;  circ  object  supp;  true  PSF  supp;  PSF1 


Sample  image 
reconstruction 


CRB-based 
SNRs  per  pixel 


Normalized  PCID  variances 
versus  SNRs 


Bias''2A/ar=0.51 


Here  we  go  back  to  10''7  photons,  but  use  a  circular  object  support  instead  of  the  true 
support.  Notice  that  the  majority  of  the  normalized  PCID  variances  are  less  than  one  - 
indicating  that  the  PCID  reconstructions  must  be  biased.  In  fact  they  are  -  the  bias^2/var 
ratio  is  0.51! 
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Bias*2A/ar  =  0.026 


w  Case  3:  Energy  Spectrum  Results 

#  photons  =  10^;  read  var=  100;  circ  object  supp;  true  PSF  supp;  PSF1 

CRB-based  SNRs  versus  Normalized  PCID  variances  Normalized  PCID  variances 
normalized  frequency  versus  frequency  versus  SNRs 


Bias''2A/ar  =  0.51 


The  corresponding  energy  spectrum  results  show  that  the  PCID  sample  variances  are 
still  close  to  the  unbiased  CRBs  for  higher  SNRs,  so  the  biases  must  be  coming  from  the 
lower  SNR  values. 


Case  4:  Image  Domain  Results 

#  photons  =  10^;  read  var  =  100;  true  object  supp;  4*area  PSF  supp;  PSF1 


Sample  image 
reconstruction 
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CRB-based 
SNRs  per  pixel 


Normalized  PCID  variances 
versus  SNRs 
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Bias''2A/ar  =  0.094 
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This  is  an  interesting  result.  When  a  larger  PSF  support  is  used,  the  PCID 
reconstructions  are  fairly  unbiased,  but  the  normalized  PCID  variances  are  very  large 
compared  to  the  CRBs.  The  amount  of  noise  in  the  sample  reconstruction  demonstrates 
the  large  variances. 


Case  4:  Energy  Spectrum  Results 

#  photons  =  10';  read  var  =  100;  true  object  supp;  4*area  PSF  supp;  PSF1 


CRB-based  SNRs  versus 
normalized  frequency 


Normalized  PCID  variances 
versus  frequency 


Bias''2/\/ar »  0.094 


Normalized  PCID  variances 
versus  SNRs 


Baseline  case 


Notice  that  tlic  iiomializcd  PCID  variances  are  very  large  in  tlie  Fourier  domain,  too. 
Furthermore,  deviation  of  the  nonnalized  PCID  sample  variances  from  one  occurs  for 
much  higher  SNRs  tlian  for  any  other  case  considered  so  far. 


Case  5:  Image  Domain  Results 

dc  =  10‘;  no  phot  noise;  read  var  ■  20;  true  object  supp;  true  PSF  supp;  PSF1 


Sample  Image  CRB-based  Normalized  PCIO  variances 

reconstruction  SNRs  per  pixel  versus  SNRs 


Bias''2A/ar  =  0.13 


Baseline  case 
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Bias*2A/ar  =  0.026 


Here  we  have  no  photon  noise  at  all;  instead,  we  set  the  dc  value  to  10''6,  and  have  a 
read  noise  variance  of  20  per  pixel.  The  reconstruction  looks  fine,  and  the  clustering  of 
the  normalized  PCID  sample  variances  is  similar  to  the  baseline  case.  Notice,  though 
that  the  reconstruction  is  relatively  biased  (bias''2/var  =  0.13).  This  shows  that  biased 
reconstructions  don’t  necessarily  have  correspondingly  low  variances.  If  the  variances 
are  lower  than  the  unbiased  CRBs,  the  reconstructions  must  be  biased,  but  the  converse 
is  not  necessarily  true. 


Baseline  case 


Bias*2A/ar  =  0.026 


w  Case  5:  Energy  Spectrum  Results  J 

dc  =  10*;  no  phot  noise;  read  var  =  20;  true  object  supp;  true  PSF  supp: 


CRB-based  SNRs  versus  Normalized  PCID  variances  Normalized  PCID  variances 
normalized  frequency  versus  frequency  versus  SNRs 


Bias''2A/ar  =  0.13 


Here  are  the  Fourier-doniain  results.  Notice  that  tlic  SNRs  for  the  read  noise  case  are  a 
bit  larger  than  for  the  baseline  case,  but  that  the  right-most  plots  are  appro.ximately  the 
same.  Look  ne.xt  at  the  2-D  map  of  the  nonnalized  PCID  variances.  Notice  that  the 
variance  is  high  right  at  dc,  and  has  is  higher  in  ‘streaks’  corresponding  to  high  values  of 
the  object’s  energy  spectrum.  We  have  noticed  this  consistently  with  PCID 
reconstructions  for  the  rcad-noise-only  case,  but  don’t  have  an  explanation  at  this  time 
why  it  occurs. 


Case  6:  Image  Domain  Results 

#  photons  =  10*;  read  var  =  100;  true  object  supp;  true  PSF  supp;  PSF2 


Sample  Image 
reconstruction 


CRB-based 
SNRs  per  pixel 


Normalized  PCID  variances 
versus  SNRs 


Bias''2A/ar  =  0.013 


Mere  we  replace  PSI-'l  wilh  PSF2.  Recall  that  the  area  of  PSF2  is  four  times  as  large  as 
PSFl.  This  allows  lower  intensity  portions  of  the  underlying  PSF  to  corrupt  the  images, 
and  thus  lowers  the  SNRs  relative  to  PSFl .  Thus,  we  also  upped  the  photon  level  to 
lO^'S.  Notice  that  the  results  look  pretty  similar  to  the  baseline  case,  except  that  the  bias 
is  half  of  the  baseline  case. 


Case  6:  Energy  Spectrum  Results 

#  photons  =  10*;  read  var  =  100:  true  object  supp:  true  PSF  supp;  PSF2 


CRB-based  SNRs  versus  Normalized  PCID  variances 
normalized  frequency  versus  frequency 


Normalized  PCID  variances 
versus  SNRs 


The  Fourier  domain  results  are  very  similar  to  the  baseline  case  as  well. 


Case  7:  Image  Domain  Results 

dc  =  10*;  no  phot  noise;  read  var  ■  2:  true  object  supp;  true  PSF  supp;  PSF2 


Sample  Image  CRB-basod  Normalized  PCID  variances 

reconstruction  SNRs  per  pixel  versus  SNRs 


Bias''2/Var  =  0.16 


Here  we  use  PSF2  and  remove  photon  noise,  leaving  only  read  noise.  Again,  PSF2 
lowers  the  SNRs  relative  to  PSFl ,  so  the  read  noise  variance  for  this  case  was  2  instead 
of  20  as  for  PSFl .  Notice  that  the  reconstruction  again  is  fairly  biased.  In  addition,  the 
sample  PCID  variances  are  larger  than  the  baseline  case. 


Case  7:  Energy  Spectrum  Results 

dc  >  10';  no  phot  noise;  read  var  >  2;  true  object  supp;  true  PSF  supp;  PSF2 


CRB-based  SNRs  versus  Normalized  PCID  variances  Normalized  PCID  variances 
normalized  frequency  versus  frequency  versus  SNRs 


Bias''2A/ar  =  0.026 


We  see  again  the  structure  in  the  2-D  nonnalized  PCD  variance  map.  We  also  see  an 
increased  spread  in  the  nomialized  PCID  variances  in  the  right-most  plot,  but  that  may 
be  due  to  the  accuracy  for  which  the  sample  variances  can  be  calculated. 


Conclusions 


*  The  Fourier  domain  seems  to  be  a  much  better  place  to  evaluate 
PCID  performance  relative  to  the  CRBs 

*  When  true  object  and  PSF  supports  are  used  in  the  PCID 
algorithm,  the  PCID  sample  variances  match  the  CRBs  very  well 
for  SNRs  >  -2 

*  When  larger  supports  are  used,  PCID  doesn’t  necessarily 
converge  to  the  global  minimum,  and  reconstructions  can  be 
biased. 

*  Read  noise  reconstructions  tend  to  be  biased,  and  have  more 
structured  Fourier-domain  normalized  variances. 

*  Biased  reconstructions  can  lead  to  lower  variances,  but  not 
always. 


Future  Work 


*  Try  to  extend  qualitatively  unbiased  CRBs  to 
regularized  and/or  positivity/constrained  MFBD 
reconstructions 


—  Calculate  energy  spectrum  variances  and  biases  in 
the  high-SNR  (low  to  mid  frequency)  region 

—  Assume  that  the  biases  in  this  region  are  due  to 
regularization,  and  scale  multiplicatively  the  CRBs 
by  these  scale  factors 

—  Compare  and  see 


Some  thoughts  on  how  to  approximate  biased  CRBs  for  positivity  and  regularization  by 
unbiased  CRBs  and  estimates  of  the  biases 


The  variances  of  any  unbiased  estimate  of  the  pixel 
intensities  6(x)  of  o(x)  are  no  less  than  the  CRBs  (the 
diagonal  elements  of  the  inverse  of  the  Fisher 
information  matrix  F): 

var{6(x)}>  diag(F'’) 

where  the  element  of  F  in  the  row  and  the  j*'’  column, 
F^j,  is  given  by 


F,=E 
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Standard  text-book  CRB  tlieory 


Cramer-Rao  Bound  Theory  For 
_ Pixel-Based  MFBD _ 

*  The  variances  of  any  unbiased  estimates  of  the  pixel 
intensities  of  o(x)  and  {hn,(x)}  are  no  less  than  the 
CRBs  (the  diagonal  elements  of  the  inverse  of  the 
Fisher  information  matrix  F): 

var{[6(x).h,(x),h2(x) . ^^(x)]^)  ^  diag(F-') 

when  F  is  invertible 


Standard  text-book  CRB  theory 


PCID  8.1  vs.  PCID  7.3b:  Image  Domain  Results 

#  photons  =  10^;  read  var  =  100;  true  object  supp;  true  PSF  supp;  PSF1 


Sample  image 
reconstruction 


CRB-based 
SNRs  per  pixel 


Normalized  PCID  variances 
versus  SNRs 


Bias''2/Var  =  0.024  'on 


Comparison  of  reconstructions  from  an  older  version  of  PCID  (7.3b)  and  a  newer 
version  (8.1 )  Notice  that  the  results  are  very  similar. 


S^J  PCID  8.1  vs.  PCID  7.3b:  Energy  Spectrum  Results 

#  photons  =  10^;  read  var  =  100;  true  object  supp;  true  PSF  supp;  PSF1 


CRB-based  SNRs  versus  Normalized  PCID  variances  Normalized  PCID  variances 
normalized  frequency  versus  frequency  versus  SNRs 


PCID  7.3b 


Comparison  of  reconstructions  from  an  older  version  of  PCID  (7.3b)  and  a  newer 
version  (8.1 ).  Notice  that  the  results  are  very  similar. 


PCID  Output  -  True  Supports 


PCID7.3b 


PCID  8.1 


MnMiiirManii»*»wmiw?^»ww _ immm- 


it4»irsrB  t  tl 


1131703 

2 

lUMM  1 

343493 

193143 

13  4)23 

19)133 

*(*3 013417 

2 

9011 

12*9232 

1)73  704 

51*3797 

02373C 

11317120 

) 

23)319 

173493 

13  47571 

17291519 

■(*301343 

) 

031 

17709*4) 

1)944  03 

9*32915 

0231973 

11  317141 

4 

20793)7 

113)97) 

9)2303 

117P36D 

Rt*3 01343 

4 

0011 

123135 

I)8r93 

>)33)7) 

041970C99 

11  31713 

9 

11939)22 

1004  713 

794X143 

12911017 

■(*301343 

9 

030 

1)49*32 

1294753 

9*93  03 

0223310 

1131719) 

9 

1391)  19 

120  432 

3C:3IX 

1925)011 

■(^  01343 

9 

031 

12)941)7 

1)13  03 

233  73 

092729)97 

11  317X4 

7 

119)773 

7391947 

31533 

1501)10 

■(*3013471 

7 

031 

12)2439 

131503 

1943002 

073690C 

11  317229 

9 

931343 

994  *4934 

34  79093 

1703*3 

■(*3013  4*2 

1 

031 

12777)2) 

1)9303 

7113)7) 

0999033 

1131723 

• 

319132 

5*41773 

3)7213 

14702779 

■1*3013482 

9 

0010 

1222370 

140X23 

20892709 

0971033 

113172(7 

10 

7093273 

9)0479)9 

2723937 

142303 

■1*301350) 

10 

0011 

122X72) 

140337 

24870277 

04074319 

iittasr 
1190  3t9M 
iiaoasTf 
1190  ai  Ml 
119029  «Z2 
11902994) 


2279  UI21M2 
»79  14123M2 
14121992 

2291  1412)902 

2292  1412)992 
229)  1412)992 

119029994  234  1412)992 
11903999  2399  1413992 


0  999)10999^ 
0S94)1524(4>4 
OtltBIS43-03 
0  944099)7104 
099998311IO4 
0 10909X291 <0) 
09940701304 
0940)10)304 


093T9497IO9 
0  97699997EO9 
07S024X1E09 
0979)7l0eEO0 
011999917(09 
01IS206S2E04 
0  9423)7309 


€04  orxnTmos 


95294414 

10129717 

14727224 

940)0190 

9147317 

91211799 

1031752 

1099729 

9T2tt. 


9in9a2U  027  937 
9IPQ002303  9)3 
9EP09a2UI)49  939 
91^3029203  9400 
I1IP30292070  9401 
llfP3a2U3l  9402 
9(^30292091  940) 

lltP30292ia  9404 
9(9302311)  U» 


0010  1412)992 
0011  1412)992 
0011  1412)992 
0010  1412)992 
0011  1412)992 
0011  14IS992 
0010  1412)992 
0011  1412)912 
0011  1412)1 


0219794930) 
019S99090EO) 
013191930) 
019)002230) 
0  11939)30) 
019772941(0) 
018271790(0) 
0149)2741(0) 
014)94)2710) 


03)3171(0) 

0319)940(0) 

0239)810(0) 

0)41186)30) 

0)0969030) 

0)133130) 

0199947230) 

0193*330) 

01231)330) 


0443)317 

04709)779 

0MIS294O 

00)499:9 

04874S7M 

0499)3)07 


Some  of  the  diagnostic  output  from  one  of  the  recon.structions  used  for  the  previous  two 
slides. 


3-f 


Comparison  of  reconstructions  from  an  older  version  of  PCID  (7.3b)  and  a  newer 
version  (8. 1 ).  Notice  that  the  results  are  very  similar. 


PCID  8.1  vs.  PCID  7.3b:  Energy  Spectrum  Results 

tic  =  10‘:  no  phot  noise;  read  var  =  20;  true  object  supp;  true  PSF  supp;  PSF1 


CRB-based  SNRs  versus  Normalized  PCID  variances  Normalized  PCID  variances 
normalized  frequency  versus  frequency  versus  SNRs 


Bias*2/Var=  1.34 


PCID  7.3b 


Bias''2A/ar  =  0.13 


Comparison  of  reconstructions  from  an  older  version  of  PCID  (7.3b)  and  a  newer 
version  (8. 1 ).  Notice  that  the  results  are  very  similar. 


w  PCID  Output  -  4x  Area  PSF  Support 


PCID  7.3b 
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Some  of  the  diagnostic  output  from  one  of  tlie  reconstructions  used  for  the  previous  two 
slides. 


PCID  8.1  vs.  PCID  7.3b:  Image  Domain  Results 


#  photons  =  10^;  read  var  =  100;  circ  object  supp;  true  PSF  supp;  PSF1 


Sample  image 
reconstruction 


CRB-based 
SNRs  per  pixel 


Bias''2A/ar  =  21689.5 


PCID  7.3b 


Bias*2A/ar  =  0.64 


Normalized  PCID  variances 
versus  SNRs 
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Comparison  of  reconstructions  from  an  older  version  of  PCID  (7.3b)  and  a  newer 
version  (8.1).  Notice  that  PCID  8.1  failed  miserably  to  get  clo.se  to  the  global  minimum. 


w  PCID  8.1  vs.  PCID  7.3b:  Energy  Spectrum  Results 

#  photons  =  10^;  read  var  =  100;  circ  object  supp;  true  PSF  supp;  PSF1 


CRB-based  SNRs  versus  Normalized  PCID  variances  Normalized  PCID  variances 
normalized  frequency  versus  frequency  versus  SNRs 


PCID  7.3b 


Bias''2A/ar  =  0.64 


Comparison  of  reconstructions  from  an  older  version  of  PCID  (7.3b)  and  a  newer 
version  (8.1).  Notice  that  PCID  8.1  failed  miserably  to  get  close  to  the  global 
minimum. 


PCID  Output  -  Circular  Object  Support 
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Some  of  the  diagnostic  output  from  one  of  the  reconstructions  used  for  the  previous  two 
slides. 


PCID  8.1  vs.  PCID  7.3b;  Image  Domain  Results 

#  photons  =  10^:  read  var  =  100;  true  object  supp;  4*area  PSF  supp;  PSF1 


Sample  image 
reconstruction 


CRB-based 
SNRs  per  pixel 


Normalized  PCID  variances 
versus  SNRs 


Bias''2A/ar=  1.34 


Comparison  of  reconstructions  from  an  older  version  of  PCID  (7.3b)  and  a  newer 
version  (8.1).  Notice  that  the  PCID  7.3b  reconstruction  is  essentially  unbiased,  and  this 
shows  in  the  noisiness  of  the  reconstruction.  The  PCID  8.1  reconstruction  is  very 
biased,  but  has  much  higher  visual  quality. 


PCID  8.1  vs.  PCID  7.3b:  Energy  Spectrum  Results 


#  photons  =  10^:  read  var  =  100;  true  object  supp;  true  PSF  supp;  PSF1 


CRB-based  SNRs  versus  Normalized  PCID  variances  Normalized  PCID  variances 
normalized  frequency  versus  frequency  versus  SNRs 


Blas''2A/ar  =  1.34 


PCID  7.3b 


Bias''2A/ar »  0.094 


Comparison  of  reconstructions  from  an  older  version  of  PCID  (7.3b)  and  a  newer 
version  (8.1 ).  Notice  the  scale  difference  between  the  two  right-most  plots.  The  PCID 
7.3b  results  are  much  noisier. 


PCID  Output  -  4x  Area  PSF  Support 
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Some  of  the  diagnostic  output  from  one  of  the  reconstructions  used  for  the  previous  two 
slides. 
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